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ABSTRACT . : 

/ The impact of data discrepancies made by colleges on 
the Fiscal Operations Report and Amplication to Participate (FISAP) 
is addressed, with attention to both impact on the entire aid program 
and resource allocation to institutions. Brief descriptions are 
provided of tfce allocation formulas for the three campus-based aid 
programs (Supplemental Education Opportunity Grants, National Direct 
Student Loans, and the College Work-Study, program) .' The recompu taction 
of national and state fair share allocations requires two 'steps: 
recomputation of institutional need for each "program; and estimation 
of changes to allocations using Department of Education worksheets. 
The final step is to develop a national estimate of changes- in 
institutional allocations. In developing error profiles, one focus is 
on institutions," and the results may lead to selection criteria for 
increased edit checks or data verification. Another focus of the 
profiles is' the data discrepancy itself and the causes of the errors- 
Included is list of FISAP data that have been examined as part of 
the Department /of Education Quality Control Project, along with 
information on/ the types and frequency of discrepancies that have not 
yet been corrected. (§W) 
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\ As' part of the Title IV Quality Control Project, Advanced Technology, Inc. 
conducted two rounds of data, collection related to erroV in the application and 
allocation processes of the Campus-Based, programs. The first 4ata collection 
occurred at' the Department q£ Educatidn and examihed several data sources to 
identify" discrepancies in FISAP reported data/ Over SO such 'discrepancies in 
enrollfnent, tuition and fees, and Pell expenditure data were discovered. The foiiowing- 
FISAP data were examined: 

- ; • . . -\ * • • . • 

Maintenance of effort ■ . * ' 

Undergraduate tuition and fees* ■ • " 

* ^— " ► * 

Graduate tuition and fees 

Pell exptjfnclitures t ^ 
State expenditures 

>. - 

Institutional expenditures 

Undergraduate dependent applicants * . 
Graduate dependent applicants 
Undergraduate independent applicants 

Graduate independent applicants " .. - „ v 

Undergraduate enrollment • * * 

v 

Graduate enrollment 

Continuing education v 1 

New ^proliment • . * 

r 

The institutions whose FISAP's contained one or more discrepancies were 

selected for supplementary data collection during the institutional 'site visits. Data 

discrepancies were presented to institutional staff and staff were asked to •explain or 

' 7 . 

demonstrate that these discrepancies were corrected. Over half of the discrepancies 

identified were -resolved. Table 1 indicates the types and "frequency of remaining 

discrepancies. f ■ 




TABLE t * 

ERRORS ASSOCIATED WITH THR 
APPLICATION PORTION OF THfe FiSAP: 

« 

5ELUCTl*0 STATISTICS 



« 

t 1 




* * 

Responses 


Received* 


r— — = * — *- — - 

Comparisons 


Discrepancies Resolved * 


Dacrepancies Not Resolved 1 


/ 

Discrepancy item 


Number of 
Uiscr c p*tnc ies 
Identified 
for Review f 


. Number 


< 

Percent 


Cross- 
Source 

f 


^Cross- 
Year 


Number \ 


- * * 

Percentage 


* 

Number \ 


* * * 
Percentage 


A 

tfjiroMuieut ? 

✓ 


60 


- _ - JK. LL._L_.__ 


11.1% 


50 




% 21 , 


55% 






. ,.«___ . — 

Tuition and Fees 


S 


I 


1G0 


3 




" . 5 . 
, *' 


42.5 


3 


, 37,5 


« Pelt L»4H!udiUircs * • 


i 


6 

* 




3 


0 

* 


3 


100 


o 

i 


0 

T"' *- " — " i 


liitgibic Applir__.il! 

llKOflie 


S 






» , 

0 




» &> 




r 

i 


16.6 


TOTAL 


53 


70 

* 




56 


1% 


t 

ki 

ft 


5S.4 







<Of 81 institutions identified for item discrepancy, resolution, 61 provided information on 70 discrepancies. 
2 0f total enrollment discrepancies, all but three were generated by comparison* to HEGSS, * 
3rivc enrollment discrepancy lor one institution w*s both cross-source and crow-year. It was counted as two separate errors, but with one resolution. 
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The remaining discrepancies will be analyzed in 6*rder to produce the following 



four error measures: 



1 



• Likelihood of occurrence j 

• Severity, or size, of error 

. ■ » 

• . Need consequence* , / ■• * 

• Allocation* consequence * 



These four measures are briefly defined ih the following paragraphs. 

■ * 

Likelihood of occurrence is the proportion, or percentage, $i institutions for 
which an unexplained difference exists between the appiicatipn value and the 
comparison value. Table 1 provides results of the data^ collection for this error 
measure- m 

Severity or size of difference in error provides an estimate of the seriousness of 
differences between, application values and comparison Values. These measures are 
reported as the average error or average difference between the t\w© values. - 

Need consequence peasures estimated effects of data' element errors on .the 
measures of absolute aggregate need calculated for each campus. This type$of 
rneas^ is used for^data elements for which the comparison values represent exact 
values, inciuding HEGIS enrollment "and tuition and Pell expenditures. -For example, it 
is possible to estimate the need consequence of differences between ; reported 
enrollment and HEGI'S enrollment. - • ' 

Allocation consequence measures estimated effects of need changes on Campus- 
Based program allocations. Allocation consequences may not follow the same pattern 
as need consequences because of various hold-charmless considerations. 

PROPOSE^) ANALYSIS 

The major objective of the last portion of Stage I FISAP analysis .is the 
estimation of the impact of data discrepancies on allocations to institutions with 
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remaining discreptnciesyas well as a program-wide' estimation of this impact. T-he 
genera! approach to the remaining analysis consists of the following steps: 



Obtain institutional allocation worksheets from ED 
Identify institutions with data discrepancies 

ubsti 



Recompute^ristlbi^onai need for these institutions by s 
pant data using the prescribed need formula 



tituting discre*- 



Recompute institution^ allo^tions^ErK recomputed need figures, taking 
into account hoioVharmiess provisions / " ' . 

- 4 ■ v 

Estimate the order f>f magnitude anfcf direction ot*chan^es in national 

allocations 
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EISAPiInstitutional j /Ulocations ' 

The allocation of Campus-Based funds to postsecondary institutions is a function 

ss 

of three fafctors; a conditional guarantee and institutional need for funds relative to 
other institutions within the respective state and all institutions nationally. The 
•conditional guarantee (for the majority of institutions (other than institutions for the 



first or second year) is equal to CW-S anS SEOC expenditures for the 1979-SO award 
ye^ar. For NDSL this amount equals 90 percept of the greater of expenditures in the 
prior award year or ' current year multiplied by its utilization rate for loan funds. 
Institutional need for funds for Campus-Sised programs is based on an algorithm that 
suDtracts institutional resources from co^ts^ .The two formulas for the three Campus- 
Based programs are: 




SEOG institutional need = .75 x ((avg. tuition, and fees for undergraduates^) + 

(avg. living cost)) x (the number of eligible aid appii- 
*f cants) - aggregate family contribution - Pell expendi- 

^ 1 tures - state, expenditures -.25 x institutional expen- 

* „ ■ ditures ' 

4 

C'V-S and NDSL institutional need s ((avg, tuition and fees for undergraduates, 

graduates) + (avg. living cosj\ of under-. 
* graduates, graduates) x (numtfer of under- 

graduate, graduate aid applicants) - (aggre- 
gate family contribution) 



The components of the formulas are ail ^elf-explanatory except for the aggre- 
gate family contribution. For each income category of* eligible aid applicants, a 
family contribution amount is assigned by ED.. This amdunt differs by type of 
♦ enrollment (undergraduate or graduate) and dependency status. To calculate the 
aggregate family contribution for an institution^ the number of eligible aid applicant? 
at isach income t ievej is multiplied by the average family contribution^ and those 
products are then summed first across, income groups and then by type of enrollment 
and dependency status.* * 



This need computation then drives the calculation ofjhe ttoo other ^components, 
of the institutional allocation: the institution's "national fair share" and "state fair 
share" increases. The institutions national fair share increase is computed as the ratio 
of the institution's SEOp ,or self help need to the sum of computed need for ail 
institutions nationwide multiplied by the .program funds available foe the national 
increase. The state fair share increase is computed similarly by multiplying the ratio 
of the institution's SEOG or self help need to the sum of computed need for ail 
institutions within the state by the fuhds available for the state fair share increase. 



ANALYTIC PROCEDURES* 

/ ' * 
The primary focus qf the proposed 'analysis is the estimation' of changes to the 

. national ana state fair share allocations for institutions whose FISAP contained 

unexplained discrepancies.' 'We propose this focus because many*institutions receive a. 

substantial portion of Campus-Sasgd funds for one or more programs based through the. 
*the conditional guarantees which are not affected by errors we assessed. Regulation* • 

state thjjj institutions' will receive such a guarantee "unless -it suffers a .substantial 

decline in enrollment." w 



c The recomputation of. national and state fair shar£ allocatfbns 1 r»fuires two * 
f * steps. First, instiiutional need for each program must be recomputed. This involves 
% substituting ^the most reliable data for discrepant items in the need algorithm. F.or 
instance, the correct enrollment data from HEGIS will be substituted for data reported 




The SEOG allocation algorithm does not contain a state increase for Continuing 
Year (C.V.) funds. ' — 



<» 
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on\the FISAP, in casesr where discrepancies remain. This recalculated seed will then 
be used to estimate changes ^institutional allocations and^ will result in estimations 
of the need consequence of data discrepancies. 

Our approach to' the estimation of changes to allocations, the second step, 
• • i * 

requires the use of the worksheets that accompany ED notices to institutions of 

allocation o'f program funds. These forms are expected to contain the individual 

components of th# allocations which we will adjust, to estimate ailocaifan changes. 

Thus, the availability of these" worksheets is crucial to the analysis and coYflsritutes the 

simplest means of gathering necessary data. * 

If worksheets are unavailable fpr* . any institutions, particularly those witti 
remaining discrepancies for which we will estimate changes to allocations* they cannot 
, included in the analysis. Clearly, if the number of institutions for which worksheets 
are unavailable is high ^and„ sufficient data cannot be easily obtained, the current- 
approach and proposed anWysis may have to be abandoned. '. 

\ .I 

Jtising these worksheets, changes to the national fair* share increase #ili Ue 
estimated by multiplying the ratio of 'recalculated need to reported need* by the 
amount of the national fair share increase* This will -result in the estimated increase 
or decease in the national fair share caused by the use of more reliable* data. 



m * A similar procedure will be usejd for the state fair share increase/ T^e ratio used 
above will tje multiplied by the state fair share increase to obtain the recomputed- 
state fair share increase. This is slightly different for SEdfc since there is no C.Y. 
state fair share increase and therefore 'the state increase only includes I.Y. funds. 

The recomputed national and s/ate fair shate increases for each program wiil i>e 

» 

added- tc* the 1 conditional guarantee amount for the respective* programs. The result 
viil be an estimation 7 of the. recomputed Campus-Sased allocations for institutions 
with remaining- discrepancies. - - 

^ The final step in the proposed analysis, will be developing a natiprfal estimate of 
:*aVi*es in in&itutionai allocations. Because of the nature of the Title IV Quality 
Control sample, the sum of the student sampling weights at each institution wiil allow 
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us «to' use the' changes in institutional allocation Jo estimate national changes. 
Similarly, the sum o| these sampling weights at each* institution multiplied by the 
institution's Campus-Based allocation summed across alfr' sampled Institutions will 
equal program totals for allocations. * • „ 

< ♦ 

In order to estimate nat|onaf changes in allocations, we will subtract- the 

recomputed allocation from the original allocation- to obtain v the difference. This 
difference will be multiplied by the sum of the student sampling* weights at that 
institution. The sum of this amount across all institutions wi^h remaining discrepan- 
cies will constitute the national estimate of changes in Campus-Based allocation due 
to these discrepancies. . 

••> It should be noted that the individual discrepancies could have little or no effect 
on allocations under certain circumstances. For instance, it is *plauiibie that the state 
fair share could be zero, since the amount available within states for distribution as 

r state fall* share increases, is computed by subtracting "the sum of the cond tional 
guarantees from the the State* allotment. Thus, if the state increase is zero, small 
changes in institutional need will have a- minimal effect on institutional allocations • 
within that state since only tipe national increase could be affected by recalculation. 
Consequently, it is possible that what appear, to be fairly large' changes in reported 
application data, such as enroilment n couid cause only small changes in allocations. ' 

* * 

Erro£ Profiies 

An objective of the proposed analysis is* the development of a profile for 
discrepancies. Developing such a profile can take two discrete focuses/ The first is to 
focus on .institution. The analysis related to this, focus would use statistical 
techniques to describe the variation in the occurrence of particular types of er^or by 
key institutional characteristics such as size, type 2nd control or adrninstrat^on 
procedures. The results of this analysis .would lend itself to selection criteria for 

increased edit checks or data verification. A • " 

/ ■ 

Another focus is on the '.data discrepancy itself .and the causes of these errors. 
This -focus* wouid use descriptive techniques to identify the magnitude of and most' 
\frequent causes of error through explanations provided by institutional staff and would 
lend ittfelf to the development of editTchecks and corrective actions. r 
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-Our'ability to 'conduct' an analysis, particularly for the first focus, is constrained 
by the number of unresolved discrepancies (29). Realistically, only -unresolved 
enrollment discrepancies (2*0 cart be analyzed to any degree. However, even cross- 
tabulating these discrepancies by type and control^ resulting in 12 cells, could produce 
-unreliable results without Vsing additional procedures, since one or more cells could be 
empty.' Even including all types of error sin ah error/no error variable only marginally 
improves this analysis. .Consequently, we are limited by our data to simple descriptive, 
statistical analysis and all but eliminates the first focus as a "meaningful 1 analysis. 

TJJe second focus, although still Umhed by the data, holds more promise, 
• particularly because the data collected about the causes of error is *emewhat richer 
since staff explained the reasons for discrepancies. This. data will fend- meif to- a 
combination of qualitative ana** quantitative analyses. Therefore, we propose to' 
analyze the * reasons for the occurrence of FISAP discrepancies and to recommend 
corrective actions, to eliminate these discrepancies. jl v "*" 

Data Needs ' > 

* ,.•■"'''»' 
The following data are needed to conduct the proposed analyses: 

r • „. * * ' ■ . 

• 'Allocation worksheets for all sampled institutions ' . 

• EFCs for the need income grid * • / 

• Cost of attendance developed by ED 

! * • m 

/ * 

t % 

We have already requested ^that we receive, copies of the worksheets. The 
remaining data will be required before we can proved with the analysis*. 
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